Combining Multimodal Information for Metal Artefact Reduction:An Unsupervised Deep Learning Framework

Metal artefact reduction (MAR) techniques aim at removing metal-induced noise from clinical images. In Computed Tomography (CT), supervised deep learning approaches have been shown effective but limited in generalisability, as they mostly rely on synthetic data. In Magnetic Resonance Imaging (MRI) instead, no method has yet been introduced to correct the susceptibility artefact, still present even in MAR-specific acquisitions. In this work, we hypothesise that a multimodal approach to MAR would improve both CT and MRI. Given their different artefact appearance, their complementary information can compensate for the corrupted signal in either modality. We thus propose an unsupervised deep learning method for multimodal MAR. We introduce the use of Locally Normalised Cross Correlation as a loss term to encourage the fusion of multimodal information. Experiments show that our approach favours a smoother correction in the CT, while promoting signal recovery in the MRI.Comment: Accepted at IEEE International Symposium on Biomedical Imaging (ISBI) 202

Lesion-wise evaluation for effective performance monitoring of small object segmentation

Object detection in medical images using deep learning is a challenging task, due to the imbalance often present in the data. Deep learning algorithms require large amount of balanced data to achieve optimal performance, as well as close monitoring and ne-tuning of hyper parameters. For most applications, such performance monitoring is done by simply feeding unseen data trough the network, and then using the loss function for evaluation. In the case of small or sparse objects, the loss function might not able to describe the features needed, but such features can be hard to capture in a loss function. In this paper we introduce a lesion-wise whole volume validation tool, which allows more a more accurate performance monitoring of segmentation of small and sparse objects. We showcase the efficacy of our tool by applying it to the task of microbleed segmentation, and compare the behaviour of lesionwise-whole volume validation compared to well known segmentation loss functions. Microbleeds are visible as small (less than 10 mm), ovoid hypo-intensities on T2∗-weighted and susceptibility weighted magnetic resonance images. Detection of microbleeds is clinically relevant, as microbleeds can indicate the risk of recurrent stroke, and are used as imaging biomarker for various neurodegenerative diseases. Manual detection or segmentation is time consuming and error prone, and suffers from high inter- and intraobserver variability. Due to the sparsity and small size of the lesions, the data is severely imbalanced